RSS

Category Archives: Standardized Testing

Another educational fad invades an American school district: Part 4 of 5

View as Single Page

My friend’s e-mail went on: “I feel like teaching has become ALL science-based. Education officials [elected school board members and district level administrators] forget that teaching is 50% of an art-form and 50% science. This curriculum does not allow me time to conduct classroom debates, infuse my curriculum with health science-based activities and articles, and to teach grammar in a systematic way …

“I think the Synced Solution software program would be good for a first-time teacher. New teachers could use the guidance and structure, but I resent it. I think there has to be more flexibility. For example, I think the program should say which standards should be covered on a weekly basis rather than on a daily basis.

“My district wants to script my teaching; also, my district can now see if I am covering the standards using its timeline. We will have unit tests, and there is an area in the software program that we are supposed to check off (checking off the objectives and standards).

“The other teachers and I concurred that this software program will add at least an hour to our teaching day. Instead of technology assisting us, it is making our jobs even more cumbersome. Synced Solution is very cumbersome to navigate.


Teleparent is a program that teachers want and need. Who teaches students? Who makes the most phone calls to parents?

“I would rather have my school bring back TeleParent. I don’t know if you ever had this automated phone program when you were teaching [I didn’t], but we had it for two years, and then my school took it away.

“TeleParent allowed me to contact a group of students having the same negative academic behavior.”

“For example, 20 students forget their textbook. I could just go through my class list on TeleParent and check off the names of students who forgot their textbook. Then, I could check off the reason for the phone call, Forgot textbook. Teleparent would contact my parents in their primary language (Spanish, Mandarin, Tagalog, etc.).

“Also, it would use a different phone number so that my students would not know it was Teleparent; this prevented students from intercepting the corrective phone calls [which some students would do—believe me]. It exponentially increased my number of parent contacts. Negative classroom behaviors changed very quickly. Teleparent could easily raise the test scores for a high school. Every time my colleagues and I want a software program that makes our job easier, the district and/or my school rejects it. We wanted Turnitin.com, but my school refused.


Another valuable tool for teachers that teachers want.

Turnitin.com is a powerful software program that detects plagiarism in essays and also in research papers. This software program would make my job so much easier. I would not have to hunt on the Internet to locate the research that a student copied into his paper.”

My friend teaches in the Chino Valley Unified School District.

Continued on August 21, 2013 in Another educational fad invades an American school district: Part 5 or return to Part 3

View as Single Page

_______________________

Lloyd Lofthouse is a former U.S. Marine and Vietnam Veteran.

His latest novel is the award winning Running with the Enemy. Blamed for a crime he did not commit while serving in Vietnam, his country considers him a traitor. Ethan Card is a loyal U.S. Marine desperate to prove his innocence or he will never go home again.

And the woman he loves and wants to save was trained to kill Americans.

To follow this Blog via E-mail see upper right-hand column and click on “Sign me up!”

 

Tags: , , , , ,

Another educational fad invades an American school district: Part 1 of 5

View as Single Page

Before I comment on what a friend—who is still in the classroom teaching—wrote in a recent e-mail about the district he/she teaches in, I want to mention my own thirty years as a teacher [1975 – 2005] as a way to establish that I know what I’m talking about.

During my early years in the classroom, many of my seventh and eighth grade students won half the poetry awards in a state-wide contest in California. The award ceremonies were held on the Queen Mary in Long Beach.

The poems that won came out of a workshop I developed, and that success led me to develop a short-story writing workshop where two of my eighth-grade students one-year ended up published in a special edition of a Los Angeles Times Magazine that showcased maybe twenty or thirty short stories out of more than 10,000 submitted from schools in Los Angeles County.

That was back in the late 1970s and early 1980s. In fact, over the years, I developed most of my own curriculum to teach English and writing that I used successfully for decades.

In the 1990s, when I taught journalism and was the advisor of a high-school newspaper—in addition to teaching four periods of English—my journalism students won national and international recognition for their work.  In fact, you can read about it here. Just click on the next link to see what the Rowland Heights Highlander had to say: Extra! Nogales newspaper a five-time winner

In the late 1990’s, a vice principal told a room full of English teachers at the high school where I taught that my students outperformed—by a large margin—the students of every English teacher in the district at the same grade level when it came to writing.  At another meeting, another VP would mention that my students—year after year—always showed gains, on average, on annual standardized tests.

I was a tough, no-nonsense teacher who often created his own curriculum units and that included getting ideas from other teachers who I worked with. Some of my best teaching methods were learned from other veteran teacher like my friend.

Continued on August 20, 2013 in Another educational fad invades an American school district: Part 2

 

View as Single Page

_______________________

Lloyd Lofthouse is a former U.S. Marine and Vietnam Veteran.

His latest novel is the award winning Running with the Enemy. Blamed for a crime he did not commit while serving in Vietnam, his country considers him a traitor. Ethan Card is a loyal U.S. Marine desperate to prove his innocence or he will never go home again.

And the woman he loves and wants to save was trained to kill Americans.

To follow this Blog via E-mail see upper right-hand column and click on “Sign me up!”

 

Tags: , , , , ,

The American Teacher “is not” Waiting for Superman – Part 1/2

The documentary “American Teacher” focused on the low pay of teachers when compared to their peers working in the private sector with similar educational backgrounds, and the back breaking demands on most teachers (working an average 60 hours or more a week – for example, I often worked a 100 hour week often starting at 6AM when the gates to the school were unlocked and staying as late as 11:00 PM when the alarms were turned on and the gates locked).

While the film was not perfect because it didn’t mention the role of parents and other pressures teachers face, it offered a more realistic view of education in America than “Waiting for Superman” did.

Points made that many of the critical reviews of this documentary ignored were:

1. 46 percent of public school teachers leave the profession within the first five years of being in the classroom.

2. Salaries and stress are among the top reasons teachers say they leave.

3. 62 percent of our nation’s teachers must have second jobs outside of the classroom-like tutoring, mowing lawns, selling stereos, or bartending—to be able to afford to teach.

From a few positive reviews of “American Teacher” —

Mark Phillips of the Washington Post said, “A film about education that gets it exactly right… Powerful and compelling. Every policymaker should be required to see American Teacher”

Joe Neumaier of the New York Daily News said, “This heartbreaking and essential look into the lives of those who put so much into educating other people’s children ought to be seen by everyone concerned about the fate of the public school system, and the nation as a whole.” – “Sobering and powerful.” – Ernest Hardy, Village Voice

Neil Genzlinger of The New York Times said, “A heartfelt, bittersweet portrait.”

Kenneth Turan of the Los Angeles Times said, “As we watch the individuals in American Teacher struggle with the burdens of the system places on them, it’s hard not to feel like crying, both for them…and our national culture.”

Note: I also spent thousands of dollars for educational materials over the years that I taught, and for a few years, I also worked a second job to pay the bills in addition to working summers in jobs such as construction, since I wasn’t paid as a teacher during the ten weeks of the summer break.

Continued on April 2, 2012 in The American Teacher “is not” Waiting for Superman – Part 2

____________________

Lloyd Lofthouse is a former U.S. Marine and Vietnam Veteran, with a BA in journalism and an MFA in writing,
who taught in the public schools for thirty years (1975 – 2005).

Graphic OCT 2015

Where to Buy

To follow this Blog via E-mail see upper right-hand column and click on “Sign me up!”

 

Tags: , , , , , , , , , , , ,

Comparing Apples to Apples Instead of Cabbages

My goal for this post was to discover how America’s public schools compared to countries with similar educational systems.  The scores used are from the 2009 global PISA rankings.

I ended up comparing the scores of nine similar countries [Western Christian cultures] with the top three [China, Finland and Singapore] and the lowest score [Kyrgystan].  The first chart lists three of the top five, the second chart includes the United States and eight similar countries, and the last chart shows the country with the lowest global score on the 2009 international PISA test.

Three of the top-five public school systems in the world as tested by PISA.

These three public school systems are very different from the United States. I’ve written about these differences in The Finland-Singapore Solution to Public Education in the U.S.

Country

Overall Reading Scale

Mathematics Scale

Science Scale

Shanghai-China 556 600 575
Finland 536 541 554
Singapore 526 562 542

Using Google and doing some research, I discovered “Nine Countries” [Western Christian cultures] that use annual standardized tests to measure student growth, which means these countries teach to the test and teachers are probably micromanaged by administration and pressured to raise test scores as is often the case in America.

The average score of Reading was 482.5 and the United States was 17.4 points higher.  Only one of the nine countries scored higher than the United States.

The average score of Mathematics was 486.7 and the United States was 0.3 points higher—three of the nine scored lower.

The average score of Science was 494.2 and the United States was 7.8 points higher. Only three of the nine scored higher.

Country

Overall Reading Scale

Mathematics Scale

Science Scale

United States

500

487

502

France 496 497 498
United Kingdom 494 492 514
Romania 424 427 428
Lithuania 468 477 491
Russian Federation 459 468 478
Netherlands 508 526 522
Germany 497 513 520
Sweden 497 494 495

The lowest-scoring public school system in the world as tested by PISA.

Country

Overall Reading Scale

Mathematics Scale

Science Scale

Kyrgystan 314 331 330

What can we learn from this?

We may learn that the political/religious critics of America’s public schools will manipulate the data to make the schools look bad and ignore the rest of the facts that say otherwise.  With this comparison, we see America from a different perspective comparing apples to apples instead of apples to cabbages.

Discover Civil Disobedience and No Child Left Behind

______________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “E-mail Subscription” link in the top-right column, click it and then follow directions.

 

Tags: , , , , , , , ,

Revealing the Uncouth Fraud One-Step at a time among Public Education’s Critics – Part 2/2

The second of the TOP 5 REASONS MANY TEACHERS QUIT  was “unreasonable, much-too-heavy workloads”. [Source: Patty Inglish at Hub Pages]

[Note: teachers are often required to contact parents daily since most parents of failing students do not contact teachers. This seldom results in any changes among failing students because the home environment and lifestyle is usually the reason students are failing.]

Number 3 was poor general working conditions.

[Note: I’ve written about working in poor conditions in several posts such as Bookies Dream, Old Faithful and Chewing Gum, Teaching With Pain, Pollution and People, Sewer Teaching is a Smelly Art, and HEPA Filters Do Not Work Miracles]

Number 4 was “Too much responsibility for accountability scores on No Child Left Behind and other standardized testing and accountability initiatives was listed as another major reason to quit.

Last, Inglish wrote, “Teaching was no longer rewarding, emotionally or fiscally, since raises in pay were denied when students’ scores were not raised high enough. Some teachers were fired for this and others quit. All this created problems regarding unfair terminations with the teachers’ labor unions and growing bad blood between teachers and their unions with administrations.

Inglish says, “One -fifth, or 20%, of public school teachers that had no previous full-time teaching experience quit in the school year 2004-2005. Overall, 65% of former public school teachers report that they are better able to balance work and personal/family life since they quit teaching. Before quitting, nearly all their time was spent on such things as rewriting lesson plans, purchasing their own supplies, and working unpaid overtime hours without additional needed training.”

[Note: as I’ve said before, my work weeks ran between 60 to 100 hours for the same monthly salary I would have earned if all I did was teach the 25 to 30 hours a week I spent with students.]

Return to Revealing Uncouth Fraud One-Step at a time among Public Education’s Critics – Part 1

______________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “E-mail Subscription” link in the top-right column, click it and then follow directions.

 

Tags: , , , , , , , , , ,

Dumping Teachers due to Standardized Test Results and Student Performance – Part 7/7

This post is the conclusion to a topic motivated by the August 2011, Costco Connection‘s debate between two education experts about teacher seniority.

The hours spent in the classroom with students are only the tip of the iceberg. Most teachers are in the classroom with students five or six hours each school day but the total hours worked may average much more.

For me, I averaged between 60 to 100 hours a week (with no overtime pay) for most of the thirty years I taught, which did not leave much time for other activities.

In addition, “Waiting for Superman” insinuated that most public school teachers are not highly educated. This is a ridiculous claim.

For example, when I became a teacher I already had six years of college with a BA in journalism, which included another year of training and classes to earn my teaching credential. Then, over the years, I was required to earn more than 20 quarter units thanks to state legislation increasing teacher requirements in addition to earning a MFA in writing.  Then there were endless workshops—some after school for a few hours and some lasting an entire workday.

By the time I retired, I had more than nine years of college and this does not count the seven years I attended writing workshops out of UCLA’s writing extension program. It is easy to claim that most teachers are lifelong learners.  Too bad we can’t say that of most students.

When I was teaching journalism in addition to several sections of English [for seven years of the thirty], I often arrived at 6 AM and left at 11:00 PM (that is a seventeen-hour day at school/work) when the night custodians turned on the alarms and locked the gates to the parking lot.  The student editors of the high school paper would have stayed longer (along with me) if the alarm had been left off.

In fact, the US was never a pioneer in public education as “Waiting for Superman” claims (find the truth in the March/April 2011 Foreign Policy magazine), and most factors that cause a child/teen to drop out of school has little if nothing to do with teachers. What influences children to drop out of school has more to do with street gangs, poverty, hunger, child abuse, parents [or lack of parenting, which is an epidemic in America today], being a latch key kid, the environment a child grows up in, and the lifestyle his or her parents provide

Sydney Morris, instead of stabbing dedicated teachers in the back by getting rid of the seniority system, why not use that youthful energy to fight for something worthy, such as demanding a public education system more like the one in Finland where teachers are supported and trusted to make the decisions.

Return to Dumping Teachers due to Standardized Test Results and Student Performance – Part 6 or start with Part 1

____________________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “Subscribe” button at the top of the screen in the menu bar, click on it then follow directions.

 

Tags: , , , , , , ,

Dumping Teachers due to Standardized Test Results and Student Performance – Part 6/7

I have a few more things to say to the Sydney Morrises of the world and those that blame teachers for the so-called failure of public education in America. [The real Sydney Morris spoke against seniority as a base for teacher layoffs in the August 2011 Costco Connection.]

It is a proven fact that teachers have PTSD because of the stress that comes with the job. In addition, there is a situation known as teacher burnout, which is probably caused by the same stress that causes PTSD.

This Australian Website on Teacher Burnout goes into detail and is a resource for teachers with any of the following nine symptoms.

1. insomnia

2. extreme tiredness

3. distancing yourself from colleagues and/or students

4. no longer caring what happens as a result of your efforts

5. an attitude shift to the cynical

6. hostility

7. taking more time to get less done

8. depression

9. drug/alcohol abuse

What’s interesting is the ratio of teachers found to have PTSD and/or Burnout is about the same. A study into stress in Western Australian schools in 1987 found that 10–20% of teachers suffered from psychological distress, with a further 9% suffering severe psychological distress (Howard and Johnson).

For more information on teacher burnout, see this report on several studies on the topic.

It is a fact that half of new teachers in America quit within the first few years and never return to education due the stress and the dysfunctional nature of an education system run mostly by elected officials and not teachers.

In addition, if you read the piece in the March/April 2011 Foreign Policy magazine, you discovered the quality of American students has always been poor and it it wasn’t because of the teachers.  Most of America’s public school teachers are highly educated, very dedicated and work extremely hard.

Continued on September 10, 2011 in Dumping Teachers due to Standardized Test Results and Student Performance – Part 7 or return to Part 5

____________________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “Subscribe” button at the top of the screen in the menu bar, click on it then follow directions.

 

Tags: , , , , ,

Dumping Teachers due to Standardized Test Results and Student Performance – Part 5/7

A recent study by an expert in combat related Post Traumatic Stress Disorder (PTSD), studied teachers in a Texas public school district and discovered that one out of three teachers had PTSD.

If seniority is removed as the sole factor for deciding which teachers lose their jobs, then every teacher in America must be evaluated for PTSD (possibly every five years) and when a teacher is discovered to have PTSD (a job related disability), he or she should receive a disability and free counseling from the Veterans Administration, which is organized to deal with this mental disorder brought on by combat and/or repeated stress related experiences.

The question in the August 2011 Costco Connection was “Should Teacher layoffs be based on seniority?”

The results arrived in the September 2011 Costco Connection and the result reveals that more Americans have abandoned its teachers after special interests have turned them into scapegoats for the failure of students that do not study and parents that do not parent and a system that does not allow teachers to make the decisions as Finland does.

The result was 31% yes and 69% no.

I’m not surprised by the results. My wife and I saw the documentary “Waiting for Superman”, which is an indictment of the public schools and teachers in America and it was pure propaganda and extremely misleading. As usual, nowhere did it mention that students must be held responsible by parents to do homework and study when a teacher assigns work to be done at home.

“Waiting for Superman” claimed the US was once a pioneer in public education, which is a lie. Ben Wildavsky writing for the March/April 2011 Foreign Policy magazine blows that myth/lie apart, when he said “Even at the height of U.S. geopolitical dominance and economic strength, American students were never anywhere near the head of the class … the results from the first major international math test came out in 1967 … Japan took first place out of 12 countries, while the United States finished near the bottom.”

In addition, what “Waiting for Superman” doesn’t want you to discover is that in the 2009 PISA international test, America placed in the top 26% for Math, top 11% for Reading Literacy, and the top 20% for Science Literacy, which is a huge improvement from near the bottom in 1967.

In 1967, twelve countries were compared in Math, but in 2009, that number was 64 countries in three subjects.

What happens when a student doesn’t perform, which means he or she does not participate in class, doesn’t ask questions when he or she is confused about a lesson [correct me if I’m wrong, but teachers cannot read minds], avoids class work, avoids homework, avoids reading assignments, will not read independently, will not study and/or misbehaves in class?

Is that the teachers fault?

Continued on September 9, 2011 in Dumping Teachers due to Standardized Test Results and Student Performance – Part 6 or return to Part 4

____________________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “Subscribe” button at the top of the screen in the menu bar, click on it then follow directions.

 

Tags: , , , , , , , , ,

Dumping Teachers due to Standardized Test Results and Student Performance – Part 4/7

In the August 2011 Costco Connection, Sydney Morris, the young teacher expert against seniority as a base for layoffs, said, “While we agree that teachers need much stronger evaluations, there are other objective factors that districts can use in layoff decisions.”

However, in Finland, teachers make the decisions while the government stays out of the process, but in the United States, Washington D.C., state legislatures, elected school boards and district administrators decide what is taught and how to teach it, and when those fads or methods do not work, teachers are blamed.

I was told by Mr. D, the teacher/administrator that handled school discipline at the high school where I taught, that 5% of the students earned 90% of the 20,000 referrals written each year at our high school of about 3,000 students.

Most students that belonged to that 5 percent were failing and stole an average of fifteen to twenty minutes a day in each class they attended due to unacceptable behavior.

The worst that would happen to a five percent student would be a detention after school and possibly two days of suspension, which was always a blessing because on the days one of the five per-centers was absent, I taught for the full period instead of writing referrals, and calling campus police officers to pick up the student (and others that supported or copied him or her).  All it takes is one student to cause others to misbehave.

One example of the type of behavior I’m talking about may be found in Having Sex With Elephants, another post.

The National Center for Educational Statistics reported that in 2008, students ages 12 to 18 were victims of about 1.2 million nonfatal crimes (theft plus violent crimes) at school… During the 2007–08 school year, a greater percentage of teachers in city schools (10 percent) reported being threatened with injury than teachers in town schools (7 percent) and suburban or rural schools (6 percent each)… However, a greater percentage of elementary school teachers (6 percent) reported being physically attacked than secondary school teachers (2 percent).  Two percent of 5 million is still 100,000.

Moreover, these statistics do not deal with kids disrupting the classroom due to unacceptable behavior.

There are more than 5 million public school teachers in the United States. Ten percent equals 500,000 and 350,000 equals seven percent.

When one student failed, her parents accused me of losing their child’s work. During the administrator, parent, teacher, student conference, I asked the student to open the binder for my class and all the unfinished work I was accused of losing was there. She had not turned anything in. The parent did not apologize for accusing me of losing the student’s work but asked me to accept first semester work during the second semester and change her daughter’s grade. I refused since the rule was that late work was not accepted. It had to be turned in on time. That mother had her daughter transferred to another teacher.

What happens when a student doesn’t perform, which means he or she does not participate in class, doesn’t ask questions when he or she is confused about a lesson [correct me if I’m wrong, but teachers cannot read minds], avoids class work, avoids homework, avoids reading assignments, will not read independently, will not study and/or misbehaves in class?

Is that the teachers fault?

Continued on September 8, 2011 in Dumping Teachers due to Standardized Test Results and Student Performance – Part 5 or return to Part 3

____________________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “Subscribe” button at the top of the screen in the menu bar, click on it then follow directions.

 

Tags: , , , , , , ,

Dumping Teachers due to Standardized Test Results and Student Performance – Part 3/7

In the August 2011 Costco Connection, Norm Scott, the founding member of the Grassroots Education Movement and one of the producers of “The Inconvenient Truth Behind Waiting For Superman”, said, “The fact that I was able to develop long-term relationships with parents, siblings and even children of former students, who were in my class, created a stable and secure environment for many of these students.”

I found this to be true.  Several years before I retired from teaching in 2005, I started to receive the children of former students that were now parents. Some of those former students had been a challenge to control and teach but maturity comes with age and by the time they were parents, they understood the value of an education and dedicated teachers.

My experience with the children of former students was always rewarding.

As a teacher that taught for thirty years and more than 150 classes (between 5,000 to 6,000 students), I had only one class where every student passed because so many studied and did the homework—one of more than 150.

Often, in most of the classes, when I walked around the room to collect homework, which reinforces the lesson I taught, of thirty-four students maybe three to five would turn the work in.

In addition, I made phone calls to parents as my friend does. Each day after school, I’d spend an hour or more calling parents asking them to make sure their children did the work assigned and studied or talk about a behavior problem.

Even with the phone calls to parents, few of the challenging students did the work and the bad behavior often continued.

I am at a loss why this fact never seems to come up in media discussions of public education. It is as if the entire burden of education rests with the teacher while the role of students and parents in the educational process is ignored or doesn’t exist.

One other factor is the stress that teachers often face daily.  When I was a U.S. Marine serving in Vietnam in 1966, we did not see action daily.  In fact, days might go by before we would go into the field on patrol, on a recon, an ambush, a field operation, or our camp would be hit.

In fact, thousands of public school teachers are phyiscally assaulted by students each school year and some end up in the hospital.

During the thirty years I taught, not a day went by that there wasn’t a behavior problem with a student. I witnessed drive by shootings from one of my classroom doorways once as school was letting out. On another evening when I was working late with the editors of the school newspaper, the member of one teen gang was gunned down outside my class by a rival gang, and not a year went by that I wasn’t threatened by a member of a street gang that was also a student in my class.

He would say, “What would you do if we jumped you, Mr. Lofthouse?”  This was one of those times when it paid to stand at six foot four and weigh 180 pounds without much fat while being a former U.S. Marine and Vietnam Veteran.  I also had this cold-eyed “killer” stare.

What happens when a student doesn’t perform, which means he or she does not participate in class, doesn’t ask questions when he or she is confused about a lesson [correct me if I’m wrong, but teachers cannot read minds], avoids class work, avoids homework, avoids reading assignments, will not read independently, will not study and/or misbehaves in class?

Is that the teachers fault?

Continued on September 7, 2011 in Dumping Teachers due to Standardized Test Results and Student Performance – Part 4 or return to Part 2

____________________

Lloyd Lofthouse is the award-winning author of The Concubine Saga. When you love a Chinese woman, you marry her family and culture too. This is the love story Sir Robert Hart did not want the world to discover.

To subscribe to “Crazy Normal”, look for the “Subscribe” button at the top of the screen in the menu bar, click on it then follow directions.

 

Tags: , , , , , , , , ,